Information processing device and data object display method

ABSTRACT

A configuration is presented that enables viewing a plurality of data objects situated in a virtual space as the visual field defined in the virtual space is changed smoothly; and that at the same time enables: supplemental information in connection with displayed data objects to be displayed; information in connection with displayed data objects to be displayed in more detail; means for dialogue with a user to be provided in situations where required; and application programs linked to the display of information and associated with that information to be executed. Included are: a step of accepting virtual-viewpoint position changes; a step of continuously changing visual field based on the virtual-viewpoint position changes, and uninterruptedly changing the display of a data object positioned within the visual field; a step of determining whether a data object positioned within the visual field satisfies predetermined geometric conditions for the visual field; and in respect of a data object that satisfies the predetermined geometric conditions, a step of executing a process preset in that data object.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application claims priority under 35 USC §119 from JapanesePatent Publication No. 2001-363240, filed Nov. 28, 2001, the disclosureof which is incorporated herein by reference. The present application isa continuation of U.S. application No. Ser. No. 10/083,540 filed Feb.27, 2002, which has been allowed, the disclosure of which isincorporated herein by reference.

BACKGROUND OF THE INVENTION

1. Technical Field

The present invention relates to a display method and display controldevice for displaying, in accordance with a visual field from a setviewpoint, data objects situated in a three-dimensional virtual space.

2. Description of Related Art

Computers connected to networks, such as the Internet for example, arecapable of retrieving massive amounts of diverse information. Inaddition, as the capacity of storage media increases, even stand-aloneinformation machines have become able to utilize vast amounts of diverseinformation.

In order to make use of such large amounts of diverse information, GUIs(graphical user interfaces) that employ a desktop metaphor, such asMicrosoft Windows™ are being used, as are web browsers such as MicrosoftInternet Explorer™ and Netscape Navigator™. These applications displayviewing target informational content arranged on a screen in a staticand planar manner; and in order to view the informational-content itemsin turn, succeeding subject matter must be displayed by replacing thesubject matter being displayed in the active window, or must bedisplayed by changing the active attribute of windows being displayed onthe screen in an overlapping manner.

When a plurality of informational items is displayed by switching fromone display to another, the sense of continuity on the screen is lost,leading to the problem of a 25 user having trouble understanding how theindividual contents are related to each other.

In order to solve such problems, an information display method has beenproposed (Japanese Pat. App. No. 2001-162322 [filed May 30, 2001];Laid-Open No. 2000-172248) wherein concatenatedly linked data objectsare arranged in a three-dimensional virtual space, and based on a visualfield defined in the virtual space, the data objects are displayed on adisplay screen; and wherein information can be perused by followingalong links while the display screen is changed uninterruptedly bychanging the visual field smoothly.

A conventional technique of this sort will be explained using FIGS. 5and 6. FIG. 5 is a conceptual view of a link structure of concatenatedlylinked data objects, and FIG. 6 10 is example displays of theconcatenatedly linked data objects.

In FIG. 5, data objects 102 and 103 are represented within data object101 as links 112 and 113, respectively, and data objects 104 and 105 arerepresented within data object 102 as links 114 and 115, respectively.Data object 106 is represented within data object 104 as link 116.

In display example 301 at (A) in FIG. 6, data object 101 and dataobjects 102 and 103 linked to data object 101 are displayed.

When a shift-viewpoint instruction is accepted, the display range ischanged according to the instruction, transitioning, for example, to thestate shown in display example 302 at (B) in FIG. 6. In this displayexample 302, data object 101, data object 102 linked to data object 101,and data objects 104 and 105 linked to data object 102 are displayed.

When a further shift-viewpoint instruction is accepted, the state shownin display example 303 at (C) in FIG. 6 ensues. In this display example303, data object 102, data object 104 linked to data object 102, anddata object 106 linked to data object 104 are displayed.

In display examples 301 through 304, the data object that occupies thelargest area within the display screen is displayed in detail, and thepreceding/following relationships of the data objects are set incorrespondence with the link modes and displayed. The fact that thedisplay within the field of view always changes smoothly in response tothe shift-viewpoint instructions enables a user to follow the links andview the data objects.

The information display method described above readily enables viewingby following concatenatedly linked information, and enables remedyingthe problem of losing sight of the interrelationships among theinformational-content items. However, this method does not take intoconsideration such matters as: displaying supplemental information inconnection with displayed data objects; displaying information in moredetail in connection with displayed data objects; providing means fordialogue with a user in situations where required; or executingapplication programs linked to the display of information and associatedwith that information.

SUMMARY OF THE INVENTION

The present invention offers a configuration that enables viewing aplurality of data objects situated in a virtual space as the visualfield defined in the virtual space is changed smoothly; and that at thesame time enables: supplemental information in connection with displayeddata objects to be displayed; information in connection with displayeddata objects to be displayed in more detail; means for dialogue with auser to be provided in situations where required; and applicationprograms linked to the display of information and associated with thatinformation to be executed.

A first aspect of the present invention is a data-object display methodfor situating a plurality of data objects within a three-dimensionalvirtual space in which a visual field is defined and displaying, from aset virtual viewpoint, data objects located within the visual field. Thedata-object display method includes: a step of acceptingvirtual-viewpoint location changes; a step of continuously changing thevisual field based on the virtual-viewpoint location changes, anduninterruptedly changing the display of a data object located within thevisual field; a step of distinguishing whether a data object locatedwithin the visual field satisfies predetermined geometric conditions forthe visual field; and a step of executing, in respect of a data objectsatisfying the predetermined geometric conditions, a process preset inthe data object.

In a second aspect, the invention is the data-object display methodaccording to the first aspect, wherein the process preset in the dataobject displays a display image different from a virtual-space displayimage located within the visual field.

A third aspect is the data-object display method according to the secondaspect, wherein the a separate image is displayed situated in front ofthe data object located within the visual field in the virtual space.

In a fourth aspect, the invention is the data-object display methodaccording to the second aspect, wherein a separate image is displayedwithin a window different from a window in which the data object locatedwithin the visual field in the virtual space is displayed.

A fifth aspect of the invention is the data-object display methodaccording to the second aspect, wherein a separate image is displayedwithin a frame different from, in an identical window with, a frame inwhich the data object located within the visual field in the virtualspace is displayed.

In a sixth aspect, the invention is according to the second aspect,wherein at least one from among a message, a modal dialogue, a modelessdialogue or information related to the data object is displayed.

A seventh aspect of the invention is the data-object display methodaccording to 5 any of the foregoing aspects, wherein the process presetin the data object executes a preset application program.

An eighth aspect of the present invention is an information displaydevice for situating a plurality of data objects within athree-dimensional virtual space in which a visual field is defined anddisplaying, from a set virtual viewpoint, data objects located withinthe visual field. The information display device in this aspect of theinvention includes: visual-field-data updating means for acceptingvirtual-viewpoint location changes; object data processing means forcontinuously changing the visual field based on the virtual-viewpointlocation changes, and uninterruptedly changing the display of a dataobject located within the visual field; process-execute-conditionsjudging means for distinguishing whether a data object located withinthe visual field satisfies predetermined geometric conditions for thevisual field; and visual-field-shift-linked process-executing means forexecuting, in respect of a data object satisfying the predeterminedgeometric conditions, a process preset in the data object.

An ninth aspect of the present invention is an information displaydevice for situating a plurality of data objects within athree-dimensional virtual space in which a visual field is defined anddisplaying on a display screen, from a set virtual viewpoint, dataobjects located within the visual field. The information display deviceherein includes: visual-field-data updating means for acceptingvirtual-viewpoint location changes; object data processing means forcontinuously changing the visual field based on the virtual-viewpointlocation changes, and uninterruptedly changing the display of a dataobject located within the visual field; process-execute-conditionsjudging means for distinguishing whether or not there is a data objectlocated in the display-screen center and occupying a proportion of thedisplay screen that is a predetermined value or more; andvisual-field-shift-linked process-executing means for executing aprocess preset in the data object, based on judgment results from saidprocess-execute-conditions judging.

An tenth aspect of the present invention is an information displaydevice for situating a plurality of data objects within athree-dimensional virtual space in which a visual field is defined anddisplaying, from a set virtual viewpoint, data objects located withinthe visual field. The information display device in the aspect of thepresent invention includes: visual-field-data updating means foraccepting virtual-viewpoint location changes; object data processingmeans for continuously changing the visual field based on thevirtual-viewpoint location changes, and uninterruptedly changing thedisplay of a data object located within the visual field; andvisual-field-shift-linked process-executing means for executing, if thedistance of a data object located in the visual field from the virtualviewpoint becomes a predetermined value, a process preset in the dataobject.

From the following detailed description in conjunction with theaccompanying drawings, the foregoing and other objects, features,aspects and advantages of the present invention will become readilyapparent to those skilled in the art.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a functional block diagram illustrating the configuration ofone embodiment of the present invention;

FIG. 2 is a functional block diagram illustrating a portion of FIG. 1 ingreater detail;

FIG. 3 is a control flowchart;

FIG. 4 is an explanatory diagram illustrating the geometric relationshipbetween a visual field and a data object in a three-dimensional virtualspace;

FIG. 5 is an explanatory diagram illustrating one example of the linkstructure of a group of data objects;

FIG. 6 is explanatory diagrams illustrating the link structure of agroup of data objects, according to conventional technology;

FIG. 7 is an explanatory diagram illustrating a link structure, as setout in the present invention, for data objects to be displayed;

FIG. 8 is explanatory diagrams illustrating examples of message displaylinked to visual-field shift;

FIG. 9 is explanatory diagrams illustrating examples of modal-dialoguedisplay linked to visual-field shift;

FIG. 10 is explanatory diagrams illustrating examples ofrelated-information display linked to visual-field shift;

FIG. 11 is explanatory diagrams illustrating examples of display, linkedto visual-field shift, of related information into a separate window;

FIG. 12 is explanatory diagrams illustrating examples of display, linkedto visual-field shift, of related information into a separate frame;

FIG. 13 is explanatory diagrams illustrating examples ofmodeless-dialogue display linked to visual-field shift; and

FIG. 14 is explanatory diagrams illustrating examples ofapplication-execution display linked to visual-field shift.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

FIG. 1 is a control block diagram of an information-processing deviceemploying a first embodiment of the present invention.

An information processing device 500, which can be a personal computer,workstation or other type of computer, includes an input device 501,which may be a keyboard, mouse or the like; an information storagedevice 502, which may be a hard disk, CD-ROM or other informationrecording device; a network interface 503, which is capable ofconnecting to the Internet, a LAN or the like; a program-storage unit504, which may be a ROM, hard disk or the like; a cache data storageunit 505, comprising RAM or other memory; a display device 507, whichmay be a cathode ray tube, liquid crystal display or the like; a framememory 506, which stores image data for images displayed on the displaydevice 507; and a data processing unit 510, which generates image datato be displayed on the display device 507.

The data processing unit 510 comprises a CPU and memory, and includes: aprocess-control module 512, a visual-field-data updating module 511, anobject-data processing module 514, visual-field-shift-linkedprocess-executing module 517, and a display-image synthesizing module519, among other modules. The configuration may be made to haveobject-data processing modules 514 and visual-field-shift-linkedprocess-executing modules 517 of a number of different kinds, tocorrespond to types of data objects or types of visual-field-shiftlinkedprocesses; generally, these are realized in a form in which programsstored in the program-storage unit 504 are loaded onto memory anddeployed.

Of the elements of the data processing unit 510, the process-controlmodule 512 controls overall processing.

The visual-field-data updating module 511 accepts instructions relatingto visual field movement inputted from the input device 501, moves avirtual viewpoint, and continuously shifts visual field data 513 withina virtual space seen from the virtual viewpoint. The display-imagesynthesizing module 519 synthesizes the partial display images generatedby the object-data processing module 514 and visual-field-shift-linkedprocess-executing module 517, respectively, and generates an appropriatedisplay image to be “displayed on the display device 507.

Object data is stored in a data storage unit 530. Object data isinformation acquired via the network interface 503 or information storedin the information storage device 502, and is present as a plurality ofitems corresponding to data objects that are candidates for being placedin the virtual space and displayed.

As shown in FIG. 2, object data 531 stored in the data storage unit 530includes: object placement data 532, which defines information relatingto placement of a data object in a virtual space; object display contentdata 533, which defines display content for a data object; andvisual-field-shift-linked process content-defining data 534, whichdefines the content of a process that is executed in conjunction withshifting the visual field, and, for executing that process, conditionsthat pertain to the geometric relation between the visual field and thetarget object.

The object-data processing module 514 carries out processes relating toa specified type of data object, and includes an object display imagegeneration function unit 515 and a visual-field-shift-linked processingmodule 516.

In the object-data processing module 514, the object display imagegeneration function unit 515 generates a data object display image basedon the current visual field data 513 for a virtual space in which aplurality of data objects are placed. The object display imagegeneration function unit 515, each time a new display image frame isgenerated, generates a display image for a data object that is to bedisplayed, based on the visual field data 513, object placement data532, and object display content data 533, and writes this display imageto the frame memory 506 via the display-image synthesizing module 519.

The visual-field-shift-linked processing module 516 refers to the visualfield data 513, object placement data 532, and visual-field-shift-linkedprocess content-defining data 534 to control execution of pre-setprocesses in conjunction with shifting the visual field. Thisvisual-fieldshift-linked processing module 516 includes aprocess-execute-conditions judging module 521, which based on the visualfield data 513, object placement data 532, and visual-field-shiftlinkedprocess content-defining data 534, judges from the geometric relationbetween visual field and data object whether conditions have been metfor executing preset processes in conjunction with visual fieldmovement. The visual-field-shift-linked processing module 516 controlsthe processes of the visual-field-shift-linked process-executing module517 based on the determination results of the process-execute-conditionsjudging module 521.

The visual-field-shift-linked process-executing module 517, inconformance with control functions of the visual-field-shift-linkedprocessing module 516, executes processes designated in thevisual-field-shift-linked process content-defining data 534. Thevisual-field-shift-linked process-executing module 517 includes avisual-field-shift-linked information displaying module 518; and of theprocesses designated in the visual-field-shift-linked processcontent-defining data 534, this visual-field-shift-linked informationdisplaying module 518 generates display content for the display device507, which it writes to the frame memory 506 via the display-imagesynthesizing module 519.

The configuration as described above enables the display of data objectswhile smoothly changing the display range by continuously shifting thevisual field, in a virtual space in which a plurality of data objectsare situated, and enables the execution of information display and likeprocesses when predetermined geometric conditions between the visualfield, the data objects in which they are pre-established, are met.

Process Flowchart

The flowchart shown in FIG. 3 will be used to explain the operations ofthe above-described information processing device 500.

When processing commences in Step 5401, visual field data is updated inStep 5402. Specifically, the visual field data 513 is updated by thevisual-field-data updating module 511 based on instructions relating tovisual field movement inputted from the input device 501.

In Step S403 a frame memory region (506) for depicting a data objectbased on the visual field in a virtual space is initialized.

In Step S404, based on visual field data and object data, the dataobject to be displayed is decided. Specifically, based on the currentvisual field data 513 and object data 531, and giving consideration todistance from viewpoint and link relation with other data objects, adata object that is present within the visual field is selected as thedata object to be displayed. A plurality of data objects to be displayedcan be selected.

In Step S405, determination is made of whether there are any dataobjects to be displayed that have not been displayed. If it isdetermined that there are data objects that have not yet been displayed,control proceeds to Step S406; if it is determined that there are nodata objects that have not been displayed, control proceeds to Step5409.

In Step S406, one data object is selected from among the data objectsthat have not yet been displayed; based on visual field data 513 andobject data 531, a display image of that data object is generated anddepicted on the corresponding region of the frame memory 506 via thedisplay-image synthesizing module 519.

In Step S407, it is determined whether the data object selected in StepS406 fulfills the conditions for execution of avisual-field-shift-linked process defined in thevisual-field-shift-linked process content-defining data 534. Forexample, if the data “object is present on an axial line that passesthrough the center of the display screen, and it appears in a size thatis at least one-third of the display screen, it is determined that theconditions for executing the visual-field-shift-linked process are met,and control proceeds to Step S408; if the conditions are not met,control returns to Step S405.

In Step S408, based on the visual field data 513, object placement data532 and visual-field-shift-linked process content-defining data 534, thevisual-field-shift-linked to process is executed. If in thevisual-field-shift-linked process content data, there are instructionsfor information display on the display screen, display content isprepared by the visual-field-shift-linked information displaying module518 and depicted on the corresponding region in the frame memory 506 viathe display-image synthesizing module 519. Thereafter, control proceedsto Step S405.

In Step S409, the contents of the frame memory 506 are outputted to thedisplay device 507.

In Step S410, it is determined whether or not to conduct a process forthe next display-image frame. If the process for the next display-imageframe is to be conducted, control proceeds to Step S402; if not, controlproceeds to Step S411 and the processends.

The geometric relation between a visual field and data object in athree-dimensional virtual space can be represented, for example, as inFIG. 4.

A data object 605 placed within a three-dimensional virtual space willhave its display conditions changed based on its relationship with acurrent viewpoint 601. As shown in the figure, the region within apyramid having the viewpoint 601 as apex is the visual field displayedon the display screen. When the visual field changes because of shift ofthe viewpoint 601 and changes in the angle of elevation, the position ofdata object 605 relative to the visual field changes, avid the displayscreen changes smoothly.

The determination of whether condition have been met for execution ofthe visual-field-shift-linked process, said determination to be made inthe process-execute conditions judging module 521, can be determinationof whether the relationship between visual field coordinate system 603having viewpoint 601 as its origin and local coordinate system 604having as its origin the central point of data object 605 meets specificconditions.

Data Object Link Structure

One example of the link structure of data objects to be displayed willbe explained using the schematic diagram of FIG. 7.

Visual-field-shift-linked processes 221 through 226 are attendant ondata objects 201 through 206 concatenatedly linked by links 212 through216.

In the example shown, links 212 and 213 for data objects 202 and 203 areprovided in data object 201, attendant on which is avisual-field-shift-linked process 221 for displaying a message. Links214 and 215 for objects 204 and 205 are provided in data object 202,attendant on which is a visual-field-shift-linked process 222 fordisplaying a modal dialogue.

A visual-field-shift-linked process 223 for activating application X isattendant on data object 203. A link 216 for data object 207 is providedin data object 204, attendant on which is a visual-field-shift-linkedprocess 224 for displaying document A in a different window.

A visual-field-shift-linked process 225 for displaying a modelessdialogue is attendant on data object 205. A visual-field-shift-linkedprocess 226 for displaying 25 document B in a different window isattendant on data object 206.

When data objects 201 through 206, which are to be displayed, meetpredefined conditions for execution of visual-field-shift-linkedprocesses 221 through 226, these visual-field-shift-linked processes 221through 226 are executed.

FIGS. 8 through 14 show examples of display screens for cases whereviewpoint is shifted with regard to a group of data objects to bedisplayed, causing the visual field to shift.

FIG. 8 shows a case where display of a message is linked to movement ofthe visual field.

In display example 311 at (A) in FIG. 8, data objects 201, 202 and 203are displayed. In this state, none of the data objects 201 through 203have met the conditions for executing their respectivevisual-field-shift-linked processes.

Display example 312 at (B) in FIG. 8 shows a state where the viewpointhas been moved forward, causing the entire visual field to advance, andthe data objects 201 through 203 are displayed larger than in displayexample 311. At such time, the conditions for executingvisual-field-shift-linked process 221 attendant on data object 201 havebeen met, and so a message 231 is displayed.

Display example 313 at (C) in FIG. 8 shows a state where the viewpointhas been moved further forward from display example 312; the dataobjects 201 through 203 are displayed even larger than in the displayexample 312. At this time, the conditions for executingvisual-field-shift-linked process 221 attendant on data object 201 areno longer met, and so the message ceases to be displayed.

FIG. 9 shows a case where display of a modal dialogue is linked tomovement of visual field. As used herein, a modal dialogue is a dialoguethat, while it is being displayed, accepts no operations other thanoperations relating to the dialogue.

Display example 321 at (A) in FIG. 9 shows a state that is the same asin (C) in FIG. 8; data object 202 is displayed in the center foreground.Data objects 204 and 205 are linked to this data object 202; however,these are not yet displayed in this display example 321.

The display example 322 at (B) in FIG. 9 shows a state where theviewpoint has been moved slightly forward from the state in the displayexample 321; the conditions are met for execution ofvisual-field-shift-linked process 222 attendant on data object 202, anda modal dialogue 232 is displayed. The modal dialogue in this exampledisplays a box for inputting a password, an OK function button and acancel function button. In this state, visual-field-shift-linkedprocess-executing module 517 is constituted to block any instructionsrelating to movement of visual field, and no operations are acceptedother than inputting a determined password in the password input box andclicking on the OK function button; or clicking on the cancel functionbutton.

When the proper password is inputted in the modal dialogue 232 of thedisplay example 322 and the OK function button is clicked,visual-field-shift-linked process-executing module 517 ceases to blockvisual field movement instructions, and movement of visual field becomespossible again, and data objects 204 and 205 linked from data object 202can now be displayed. This brings about the state shown in displayexample 323 at (C) in FIG. 9.

FIG. 10 shows a case where the display of information relating to a dataobject is linked with movement of visual field. As used herein,information relating to a data object is, for example, a web pagerelating to a data object to be displayed. In this example, informationrelating to a data object is displayed in a document display window 233opened in front of a data object display image in the visual field of avirtual space on a display screen.

In display example 331 at (A) in FIG. 10, the visual field has beenadvanced even further than in display example 323 at (C) in FIG. 9, andthe data objects 202 and 204 are displayed.

The display example 332 at (B) in FIG. 10 shows a state where the visualfield has been moved slightly forward in comparison to display example331; data object 204 is displayed large, and data object 206 linked withdata object 204 is also displayed. In addition the conditions have beenmet for execution of visual-field-shift-linked process 224 attendant ondata object 204; a document display window 233 is displayed in theforeground, and document A is displayed in this window.

The display example 333 at (C) in FIG. 10 shows a state where the visualfield has been moved slightly forward in comparison to display example332; the data objects 204 and 206 are displayed slightly larger. At thistime, because the conditions for execution of visual-field-shift-linkedprocess 224 have remained met, document A of the document display window233 continues to be displayed. The document display window 233, thedisplay position and size of which are not linked to visual field andthus do not change, is displayed in a fixed position on the displayscreen. The document display window 233 may be constituted so that theposition thereof changes according to the display position of animportant data object to be displayed, so as to avoid the area wheresuch data object is being displayed.

The display example 334 at (D) in FIG. 10 shows a state where the visualfield has been moved slightly forward in comparison to display example333; data object 206 is displayed large. At this time, the conditionsare met for execution of visual-field-shift-linked process 226 attendanton data object 206, and in place of document A document B is displayedin the document window 233.

FIG. 11 shows a case where a display image of a data object based on thevisual field within a virtual space is displayed in a data objectdisplay window 234; in this figure, data object-related informationlinked to the movement of visual field is displayed, as in FIG. 10.

In the display example 341 at (A) in FIG. 11, data object 202 to bedisplayed is displayed in the data object display window 234. When thevisual field of the data object display window 234 in display example341 is moved forward so that the conditions are met for execution ofvisual-field-shift-linked process 224 attendant on data object 204, thedocument display window 233 pops up and the document A is displayed, asshown in display example 342 at (B) in FIG. 11. Similarly, when theconditions are met for execution of visual-field-shift-linked process226 attendant on data object 206, document B is displayed within thedocument display window 233, as shown in display example 343 at (C) inFIG. 11.

FIG. 12 shows an example of display image and related information of adata object based on the visual field in a virtual space being displayedin a separate frame within a browser window 235 on the display screen.In this case, too, as with FIG. 10 and FIG. 11, a case is shown wheredata object-related information linked to visual field movement isdisplayed.

In display example 351 at (A) in FIG. 12, a web browser such asMicrosoft Internet Explorer™ is used, and document S is displayed withinthe browser window 235.

The display example 352 at (B) in FIG. 12 shows a state where in thedocument S displayed in display example 351, a link that calls up thenext display has been clicked. Specifically, data object display frame236 and document display frame 237 are displayed within the browserwindow 235; and data object 202 and others are displayed based on avisual field defined within a virtual space, and document T is displayedwithin the document display frame 237.

The display example 353 at (C) in FIG. 12 shows a state where the visualfield is moved slightly forward from the state in the data objectdisplay frame 236 of the display example 352; data object 204 isdisplayed large, and the conditions are met for execution ofvisual-field-shift-linked process 224 attendant on data object 204, anddocument T in the document display frame 237 is replaced by document A.

The display example 354 at (D) in FIG. 12 shows a state where the visualfield is moved slightly forward from the state in the data objectdisplay frame 236 of the display example 353; data object 206 isdisplayed large, and the conditions are met for execution ofvisual-field-shift-linked process 226 attendant on data object 206,causing document A in the document display frame 237 to be replaced bydocument B.

FIG. 13 shows an example of display of modeless dialogue being linked tovisual field movement. As used here, modeless dialogue is a dialoguesuch that operations not related to the dialogue are permitted even whenthe dialogue is displayed.

In the display example 361 at (A) in FIG. 13, the data objects 202, 204and 205 are displayed.

The display example 362 at (B) in FIG. 13 shows a state where the visualfield is moved slightly forward from the state in display example 361;data object 205 is displayed large, and the sample video image includedin data object 205 is a still image. In this case the conditions are metfor execution of visual-field-shift-linked process 225 attendant on dataobject 205, and so a modeless dialogue 238 is displayed. The modelessdialogue 238 in this example has a play button for giving instructionsto play the video, making possible the playing of the video, a sample ofwhich is displayed as a still image. The state where this modelessdialogue 238 is displayed differs from the state where a modal dialogueis displayed, as it is possible to move the visual field in this state.

The display example 363 at (C) in FIG. 13 shows the image displayed whenthe play button of the modeless dialogue 238 in the display example 362has been clicked, and a video image is played on data object 205. Inaddition, as shown in the figure, while the video image is being played,there is display of a modeless dialogue having a stop button forstopping the video image.

The display example 364 at (D) in FIG. 13 shows a state where the visualfield has been moved slightly forward from display example 363; dataobject 205 is displayed 10 slightly larger, and the play of the videoimage continues.

FIG. 14 shows an example of the execution of an application linked tovisual field movement.

In the display example 371 at (A) in FIG. 14, the data objects 201, 202and 203 are displayed.

The display example 372 at (B) in FIG. 14 shows a state where the visualfield has been moved slightly forward from the display example 371; dataobject 203 is displayed large, and the conditions are met for executionof the 223 attached to data object 203, causing the display of themodeless dialogue 239 for confirming whether to activate theapplication. This modeless dialogue 239 has an OK function button foractivating the application and a cancel button; when the OK functionbutton is clicked, the application is activated.

As shown at (C) in FIG. 14, when the OK function button is clicked, themodeless dialogue 239 is no longer displayed; in its place theapplication window 240 appears, and it is now possible to use theapplication.

Other Embodiments

In the above-described embodiments, determination of whether conditionsfor execution of the visual-field-shift-linked processes have been metis based on the geometric relationship between the visual field and thevarious data objects; other conditions, however, may be used. Forexample, priority values may be computed for all data objects to bedisplayed, the data object with the highest priority value is deemed therepresentative object, and determination of whether execution conditionshave been met for the visual-field-shift-linked processes is made onlyfor the representative object. Alternatively, conditions may be set thatare unrelated to visual field movement.

For example, when a data object is positioned in the middle of thescreen, and the size at which it appears is at least a predeterminedproportion of the screen width (for example, at least one third), thevisual-field-shift-linked process is executed. In such a case, if thereare a plurality of data objects that meet execution conditions, priorityin execution can be given starting those data objects that have a loworder in the link relationship.

The present invention allows the viewing of multiple data objects placedin a virtual space as a visual field defined in that virtual space isfluidly shifted; the present invention also allows the display ofadditional information relating to a data object to be displayed,provides means for when dialogue with a user is required, and allows forthe execution of application programs linked to data objects and relatedthereto.

Only selected embodiments have been chosen to illustrate the presentinvention. To those skilled in the art, however, it will be apparentfrom the foregoing disclosure that various changes and modifications canbe made herein without departing from the scope of the invention asdefined, in the appended claims. Furthermore, the foregoing descriptionof the embodiments according to the present invention is provided forillustration only, and not for limiting the invention as defined by theappended claims and their equivalents.

1. A data-object display method for situating a plurality of dataobjects within a three-dimensional virtual space in which a visual fieldis defined and displaying, from a set virtual viewpoint, data objectslocated within the visual field, the data-object display methodincluding: accepting virtual-viewpoint location changes; continuouslychanging the visual field based on the virtual-viewpoint locationchanges, and uninterruptedly changing the display of a data objectlocated within the visual field; distinguishing whether a data objectlocated within the visual field satisfies predetermined geometricconditions for the visual field; and executing, in respect of a dataobject satisfying the predetermined geometric conditions, a processpreset in the data object, wherein the data object satisfying thepredetermined geometric conditions lies on an axial line passing througha center of the visual field, and occupies at least a predetermined sizeof the visual field.
 2. A data-object display method according to claim1, wherein the process preset in the data object displays a displayimage different from a virtual-space display image located within thevisual field.
 3. A data-object display method according to claim 2,wherein a separate image is displayed situated in front of the dataobject located within the visual field in the virtual space.
 4. Adata-object display method according to claim 2, wherein a separateimage is displayed within a window different from a window in which thedata object located within the visual field in the virtual space isdisplayed.
 5. A data-object display method according to claim 2, whereina window includes a first and a second frame, a separate image isdisplayed within the first frame, and the data object located within thevisual field in the virtual space is displayed in the second frame.
 6. Adata object display method according to claim 2, wherein at least onefrom among a message, a modal dialogue, a modeless dialogue orinformation related to the data object is displayed.
 7. A data objectdisplay method according to claim 1, wherein the process preset in thedata object executes a preset application program.
 8. An informationdisplay device for situating a plurality of data objects within athree-dimensional virtual space in which a visual field is defined anddisplaying, from a set virtual viewpoint, data objects located withinthe visual field, the information display device including:visual-field-data updating means for accepting virtual-viewpointlocation changes; object data processing means for continuously changingthe visual field based on the virtual-viewpoint location changes, anduninterruptedly changing the display of a data object located within thevisual field; process-execute-conditions judging means fordistinguishing whether a data object located within the visual fieldsatisfies predetermined geometric conditions for the visual field; andvisual-field-shift-linked process-executing means for executing, inrespect of a data object satisfying the predetermined geometricconditions, a process preset in the data object, wherein the data objectsatisfying the predetermined geometric conditions lies on an axial linepassing through a center of the visual field, and occupies at least apredetermined size of the visual field.
 9. An information display devicefor situating a plurality of data objects within a three-dimensionalvirtual space in which a visual field is defined and displaying on adisplay screen, from a set virtual viewpoint, data objects locatedwithin the visual field, the information display device including:visual-field-data updating means for accepting virtual-viewpointlocation changes; object data processing means for continuously changingthe visual field based on the virtual-viewpoint location changes, anduninterruptedly changing the display of a data object located within thevisual field; process-execute-conditions judging means fordistinguishing whether or not there is a data object located on an axialline crossing a center of the display screen and occupying at least apredetermined size of the display screen; and visual-field-shift-linkedprocess-executing means for executing a process preset in the dataobject, based on judgment results from said process-execute-conditionsjudging.
 10. An information display device for situating a plurality ofdata objects within a three-dimensional virtual space in which a visualfield is defined and displaying, from a set virtual viewpoint, dataobjects located within the visual field, the information display deviceincluding: visual-field-data updating means for acceptingvirtual-viewpoint location changes; object data processing means forcontinuously changing the visual field based on the virtual-viewpointlocation changes, and uninterruptedly changing the display of a dataobject located within the visual field; and visual-field-shift-linkedprocess-executing means for executing, if the distance of a data objectlocated in the visual field from the virtual viewpoint becomes apredetermined value, a process preset in the data object, wherein thedata object lies on an axial line passing through a center of the visualfield, and occupies at least a predetermined size of the visual field.11. An information display device for situating a plurality of dataobjects within a three-dimensional virtual space in which a visual fieldis defined and displaying, from a set virtual viewpoint, data objectslocated within the visual field, the information display deviceincluding: a visual-field-data updating unit which acceptsvirtual-viewpoint location changes; an object data processing unit whichcontinuously changes the visual field based on the virtual-viewpointlocation changes, and uninterruptedly changes the display of a dataobject located within the visual field; a process-execute-conditionsjudging unit which distinguishes whether a data object located withinthe visual field satisfies predetermined geometric conditions for thevisual field; and a visual-field-shift-linked process-executing unitwhich executes a process preset in the data object satisfying thepredetermined geometric conditions, wherein the data object satisfyingthe predetermined geometric conditions lies on an axial line passingthrough a center of the visual field, and occupies at least apredetermined size of the visual field.
 12. A data-object display methodfor situating a plurality of data objects within a three-dimensionalvirtual space in which a visual field is defined and displaying, from aset virtual viewpoint, data objects located within the visual field, thedata-object display method including: accepting virtual-viewpointlocation changes; continuously changing the visual field based on thevirtual-viewpoint location changes, and uninterruptedly changing thedisplay of a data object located within the visual field; distinguishingwhether a data object located within the visual field satisfiespredetermined geometric conditions for the visual field; and executing,in respect of a data object satisfying the predetermined geometricconditions, a process preset in the data object, wherein the dataobjects are interrelated by a concatenatedly linked tree structure, andwherein the data object satisfying the predetermined geometricconditions lies on an axial line passing through a center of the visualfield, and occupies at least a predetermined size of the visual field.